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AGGREGATED CLUSTERING METHOD AND SYSTEM 
Field of the invention 

5 The present invention relates generally to data clustering and more specifically to a 

method and system for aggregated data clustering. 

Background of the Invention 

Data clustering operates to group or partition a plurality of data points into a 

10 predetermined number of clusters or categories based on one or more attributes or features. The 
efficiency of a clustering algorithm depends on several factors. First, the computation resources 
required to implement the clustering algorithm is an important consideration. It is generally 
desirable to reduce the time needed to generate results (often referred to as the convergence rate) 
and also reduce the amount of computer resources needed to implement the clustering algorithm. 

15 Furthermore, as explained in greater detail hereinafter, the prior art methods do not have a very 
efficient convergence rate. 

Second, the quality of the generated clusters or categories (often referred to as the 
convergence quality) is also another important consideration. Ideally, there is one center point 
for each category or cluster. Unfortunately, the prior art methods often generate clusters or 
20 categories with more than one center. These centers are referred to as "trapped centers" (i.e., 
these centers are trapped by the local data, but actually belong to another cluster or category). 

There are many practical and useful applications that can utilize data clustering to 
improve results. Consequently, there is much interest in developing clustering algorithms or 
methods that efficiently and effectively cluster data. 
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PRIOR ART DATA CLUSTERING METHODS 
K-Means is a well-known prior art method for data clustering. The K-Means clustering 
algorithm is further described in J, MacQueen, "Some Methods for Classification and Analysis 
of Multivariate Observations," pages 281-297 in: L. M, Le Cam & J. Neyman [eds.] Proceedings 
of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1, University 
of California Press, Berkeley, 1967 and Shokri Z. Selim and M. A. Ismail, "K-Means Type of 
Algorithms: A Generalized Convergence Theorem and Characterization of Local Optimality," 
IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. PAMI-6, NoT, 1984. 
Unfortunately, both of these approaches are limited to moving a single data point at one time 
from one cluster to a second cluster. 

Data points do not "move" in the physical sense, but each data point's membership in a 
particular cluster, which is defined by a center point, changes. For example, when a data point 
that is a member in a first cluster is "moved" to a second cluster, a performance function is 
evaluated based on the data points and center points before and after the move. One aspect of 
the clustering algorithm is to determine whether such a "move" reduces the performance 
function (i.e., whether the "move" improves the clustering results). 

It is to be appreciated that moving one data point at a time between two clusters is 
inefficient especially when many thousands, tens of thousands of data points, or more need to be 
moved. One can analogize this situation with a more common example of negotiating the best 
price for an automobile. 
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Consider an example when a seller and a buyer are separated by a difference of five 
thousand dollars between an initial offer price (e.g., $10 5 000) and a counter offer price (e.g., 
$15,000). During this stage of the negotiations, it would be very inefficient if the buyer's second 
offer is $10,000.01 and the seller counters with $14,999.99. In fact, if the negotiations where to 
continue one cent at a time, it is apparent that both the seller and buyer would be negotiating for 
a long time to come before reaching any type of agreement. Consequently, the speed at which an 
agreement is reached one cent at a time is very slow at best. 

Instead, it would be more efficient, and one would expect the buyer in real life to move 
perhaps by a thousand dollars or more in the second offer by offering, for example, $11,000. 
Similarly, one would expect the seller to move perhaps a thousand dollars in a counter offer by 
countering with $14,000. Perhaps, when the buyer and seller were only one thousand dollars 
apart, the buyer and seller would then start negotiating in increments of hundreds of dollars. 
Similarly, when the buyer and seller were only one hundred dollars apart from reaching an 
agreement, both would begin to negotiate in increments of single dollars and then in cents. 

The inefficient negotiation strategy of moving one cent at a time, regardless of how far 
apart the parties are, is comparable to what is currently being performed by prior art clustering 
methods. Since prior art methods are limited to moving a single data point per iteration, this is 
similar to negotiating on a per penny basis when in fact the parties (e.g., data points and center 
points) are thousands of dollars apart. 

From the above example, it can be appreciated that a mechanism to move more than one 
data point at a time is desirable. Unfortunately, there is no mechanism for moving more than 
one data point at a time without losing precision. In fact, if the prior art approaches were to 
move than one point at a time, there is no method that exists to quantify the amount of error 
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injected by moving more than one point at a time. 

Accordingly, there remains a need for a method and system for data clustering that can 
move more than one data point at a time without the loss of precision and that overcomes the 
disadvantages set forth previously. 
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SUMMARY OF THE IN VENTION 
It is an object of the present invention to provide a clustering method and system that is 
capable of simultaneously moving more than one data point from a first cluster to a second 
cluster. 

It is a further object of the present invention to provide a clustering method and system 
for moving more than one data point at a time from a first cluster to a second cluster while 
preserving the monotone convergence property (i.e., the property that the performance function 
decreases after every move that is made of data points between two clusters). 

It is a further object of the present invention to provide a clustering method and system 
that provides a predetermined metric for evaluating the move of more than one data point 
between two clusters, where the predetermined metric includes the geometric center of the set of 
data points currently being evaluated for move. 

It is yet another object of the present invention to provide a clustering method and system 
that provides a procedure for updating the performance function without losing precision or 
using approximations. 

An aggregated data clustering method and system. First, the data points to be clustered 
and a size parameter are received. The size parameter specifies the number of data points to be 
moved at one time in the clustering algorithm. Next, the data points are clustered by using an 
aggregated clustering algorithm (e.g., aggregated local K-Means clustering algorithm) and the 
size parameter to generate clustered results. Then, a determination is made whether or not the 
clustered results are satisfactory. If the clustered results are satisfactory, the clustering is 
stopped. Otherwise, a modified or refined parameter size is received. For example, a user can 
decrease the parameter size to reduce the number of data points that are moved from a first 
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cluster to a second cluster at one time. Then, clustering is performed on the clustered results 
generated previously by using the aggregated clustering algorithm and the revised or refined 
parameter size. The steps of determining, modifying the parameter size, and aggregated 
clustering are repeated until satisfactory clustering results are achieved. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention is illustrated by way of example, and not by way of limitation, in 
the figures of the accompanying drawings and in which like reference numerals refer to similar 
elements . 

FIG. 1 is an exemplary set of data points that are grouped into a plurality of clusters and 
that can be the input to the aggregated clustering method of the present invention. 

FIG. 2 is a flowchart illustrating an aggregated clustering method according to one 
embodiment of the present invention. 

FIG. 3 is a flowchart illustrating in greater detail certain steps of the flowchart of FIG. 2. 

FIG. 4 is a block diagram illustration of an aggregated clustering system configured in 
accordance with one embodiment of the present invention. 
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DETAILED DESCRIPTION 
In the following description, for the purposes of explanation, numerous specific details 
are set forth in order to provide a thorough understanding of the present invention. It will be 
apparent, however, to one skilled in the art that the present invention may be practiced without 
these specific details. In other instances, well-known structures and devices are shown in block 
diagram form in order to avoid unnecessarily obscuring the present invention. The following 
description and the drawings are illustrative of the invention and are not to be construed as 
limiting the invention. 

DATA CLUSTERING APPLICATION 
Before delving into the details of the aggregated clustering method and system of the 
present invention, an exemplary application is first described to familiarize the reader with 
concepts related to the invention. 

As noted previously, clustering seeks to locate dense regions of data that have similar 
attributes or features and generate categories or clusters of these "similar" data points. These 
attributes or features can be a qualitative (e.g., similar behavior, tastes, likes, dis-likes of 
consumers), or a quantitative measure (e.g., the number of items purchased by customers across 
a predefined time period). 

FIG. 1 is an exemplary set of data points that are grouped into a plurality of clusters that 
can be the input to the aggregated clustering method of the present invention. As a departure 
from prior art clustering methods, the aggregated clustering method and system of the present 
invention moves more than a single data point at one time during the clustering (i.e., changes 
membership of more than one data point from a first cluster to a second cluster at one time). 
Specifically, the aggregated clustering method of the present invention can move a plurality of 
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data points, such as a subset U, from a first cluster (e.g., cluster A) to a second cluster (e.g.. 
cluster B) at one time without the loss of precision. In fact, as explained in greater detail 
hereinafter, a user can flexibly specify the number of data points in the subset U to be moved at 
one time by using an input referred to as a parameter size. 

5 For example, the set of data points can represent a plurality of car brokers or dealers. 

This exemplary application uses two attributes or features for the clustering. The first attribute is 
the number of sedans that the particular dealer has sold in the last year, and the second attribute 
is the number of sports cars, the particular dealer has sold in the last year. 

m This particular application seeks to group the car dealers into clusters, such as a first 

J5l0 cluster (e.g., cluster A) of car dealers that are particularly good at selling sedans, a second cluster 
!;! ( e -g-> cluster B) of car dealers that are particularly good at selling sports cars, and perhaps a third 
cluster (e.g., cluster C) of car dealers that are good at selling both sports cars and sedans, 

j* Center-based clustering algorithms operate by receiving the number of desired clusters, 

Q initialization information (e.g., the random initial positions of centers), and based thereon 
15 generates center points that are at the center of clusters of data. In this case, since there are three 
desired clusters, three center points with initial points are provided to the clustering algorithm. 

Ideally, a good clustering method moves the center positions to the three clusters of data 
(i.e., a first center is moved to the center of those car dealers that sell high numbers of sedans, a 
second center is moved to the center of those car dealers that sell high numbers of sports cars, 
20 and a third center is moved to the center of the car dealers that sell a high number of both sports 
cars and sedans. 
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Clustering Method 

FIG. 2 is a flowchart illustrating an aggregated clustering method according to one 
embodiment of the present invention. In step 204, the data points to be clustered and a size 
parameter are received. The size parameter specifies the number of data points to be moved at 
one time in the clustering algorithm. In step 20 8 , the data points are clustered using the size 
parameter to generate clustered results. 

In step 214, a determination is made whether of not the clustered results generated in step 
208 are satisfactory. A determination of whether results are satisfactory can vary across 
applications and depend on the specific requirements of the particular application. Typically, 
one or more well-known metrics is utilized to determine if the clustered results meet a particular 
requirement. Steps 208 and 214 are described in greater detail hereinafter with reference to FIG. 

When the clustered results are satisfactory, the clustering stops. Otherwise, when the 
clustered results are not satisfactory, a modified or refined parameter size is received. For 
example, a user can decrease the parameter size to reduce the number of data points that are 
moved from a first cluster to a second cluster at one time. By so doing, the granularity of the 
clustering is increased. One advantage of the present invention is that the user can flexibly select 
or vary the size parameter to suit a particular clustering application. For example, with a large 
data set, a user can set the size parameter at a large value such as 1000 for the first iteration, a 
smaller value, such as 500 for the second iteration, a yet smaller value, such as 100 in a third 
iteration, etc. In this manner, the aggregated clustering of the present invention allows a user to 
selectively adjust the granularity of the clustering for each iteration, thereby increasing the 
efficiency and convergence rate of the clustering. 
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Furthermore, since the user is not limited to moving a single data point at one time as in 
the prior art clustering methods, the present invention provide the user the ability to tailor the 
granularity of the clustering based on the requirements of a particular application. 

In step 228, clustering is performed on the clustered results generated by step 208 by 
using the revised or refined parameter size. Steps 214 through step 228 are repeated until 
satisfactory clustering results are achieved. 

Aggregated Clustering System 400 

FIG. 4 illustrates an aggregated clustering system 400 that is configured in accordance 
with one embodiment of the present invention. The aggregated clustering system 400 includes a 
move determination unit 404 for evaluating whether an aggregated move of the specified number 
of data points at one time is possible and enhances the clustering results. The system 400 also 
includes an aggregated move unit 408 that is coupled to the move determination unit 404 to 
receive a geometric center 416 of the current set of data points and input information. For 
example, the move unit 408 updates the first partition count 450, the second partition count 460, 
the first partition center 454, and the second partition center 464 as described in greater detail 
hereinafter. Based on these inputs, the move unit 408 accomplishes the move from a first cluster 
to a second cluster after the move determination unit 404 determines that the aggregated move is 
needed. 

The move determination unit 404 includes a first input for receiving the data points 430 
that are partitioned into a plurality of initial partitions and a second input for receiving center 
points 434. As described in greater detail hereinafter, the partitions, center points of the 
partitions, and the number of data points in each partition (i.e., the count for each partition) may 
be updated for each iteration of the clustering in accordance with teachings of the present 
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invention. The move determination unit 404 also includes a third input for receiving the 
parameter size 438 (i.e., the number of data points to move at one time), a fourth input for 
receiving information concerning the first partition (i.e., the move from partition) and the second 
partition (i.e., the move to partition). For example, this information can include the current 
5 count 450 of the first partition, the current center 454 of the first partition, the current count 460 
of the second partition, and the current center 464 of the second partition. 

The move determination unit 404 includes a move evaluation mechanism 412 for 
evaluating whether a set of data points should be moved from a first cluster to a second cluster. 
Preferably, the move evaluation mechanism 412 utilizes a predetermined metric 413 for 
RtO performing the move evaluation. As described in greater detail hereinafter, the predetermined 
;;jr metric 413 can employ a geometric center of the data points considered for move. 

J"^ The move determination unit 404 also includes a geometric center determination unit 414 

Q for generating the geometric center of the data points to be moved at one time based on the data 
O points in the partitions. As noted previously, the move determination unit 404 uses the 
15 geometric center in the move evaluation of a current set of data points. For example, the 
predetermined metric can include the geometric center of the set of data points evaluated for 
move. The geometric center of data points is also provided to the aggregated move unit 408 for 
use in updating the partitions. 

The aggregated move unit 408 includes a count update unit 470 for updating the count of 
20 the first partition and count of the second partition to accurately reflect the partition counts after 
the aggregated move. The aggregated move unit 408 also includes a center update unit 474 for 
updating the center of the first partition and center of the second partition to accurately reflect 
the partition centers after the aggregated move. 
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For example, the count update unit 470 adjusts the count for the Move_From partition 
and the count for the MoveJTo partition to generate a first partition (FP) count update and 
second partition (SP) count update, respectively. Specifically, the count for the Move_From 
partition is decremented by the number of data points involved in the move. Similarly, the count 
5 for the MoveJTo partition is incremented by the number of data points involved in the move. 
The center update unit 474 adjusts the center of the MoveJFrom partition and the center of the 
MoveJTo partition to generate, for example, first partition (FP) center update and second 
partition (SP) center update, respectively. Specifically, the center for the Move_From partition 
p is calculated by using the geometric center of the data points that are being moved. Similarly, 
|£;10 the center for the MoveJTo partition is calculated by using the geometric center of the data 
"£ points that are being moved, 

5 These updated partition counts and centers for the first partition and the second partition 

U are then provided to the move determination unit 404 for further move evaluation processing 

O 

% m should the current iteration generate clustered results that are not satisfactory. 

15 The aggregated clustering method and system of the present invention moves more than 

one data point at a time from a first cluster to a second cluster while preserving the monotone 
convergence property. The monotone convergence property is the property that the performance 
function decreases after every move that is made of data points between two clusters. 

Aggregated Clustering 

20 FIG. 3 is a flowchart illustrating in greater detail an aggregated clustering method of 

according to one embodiment of the present invention. In step 304, K initial center positions are 
received. Each center is denoted by mk where k = 1, .. , K, where K is the number of clusters 
(which is herein referred to also as "partitions"). The number of clusters or partitions can be 



Attorney Docket No. 1 0992482 ' 

-14- 

specified by and adjusted by a user to suit a particular application by setting a size parameter 
variable. The initial center points can be random points or the output of some initialization 
algorithm, which are generally known by those of ordinary skill in the art. 

In step 308, a plurality of data points are received and partitioned into a plurality of 
clusters based on the distance of the data point from a center point of a respective cluster. Each 
cluster has a center point, and each data point is placed into one of the clusters {S K } based on a 
relationship (e.g., the Euclidean distance) between the center point and the data point. 

In step 314, at least two data point in a first partition (e.g., cluster A) are 
simultaneously evaluated for moving to every other partition (e.g., cluster C and cluster B). For 
example, subsets of U points are evaluated by an evaluation expression provided herein below. 
For example, in the example given in FIG. 1 , the size parameter is equal to four. All possible 
combinations or subsets having four data points from the total eleven data points in cluster A are 
evaluated for move to cluster B or cluster C. 

The index / is utilized to represent the partition to which a data point x currently belongs 
or is a member of, and the index j is utilized to represent the partition that is currently being 
evaluated for a potential move to which the data point x can be moved. The present invention 
provides the following predetermined metric for evaluating whether a set of data points should 
be moved from the current partition to a proposed or potential partition: 

n r \U\ U n^\U\ 
where U is the subset of data points (U is a subset of Si) being evaluated for the move, 
\U\ is the size of U that is specified by the size parameter, mjj is the geometric center of U, m t 
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and rrij are the centers of the clusters and n t and n y are the counts of the clusters. 

In decision block 3 18, a determination is made whether the value generated in step 3 14 is 
greater than zero. When the generated value is greater than zero, processing proceeds to step 
344. In step 344, the set of data points U is moved from a current partition Si to a second 
partition Sj. Moving the set of data points from a current partition to a second partition can 
involve the following sub-steps. First, the count of each partition needs to be updated. Second, 
since the membership of both the partitions are changing (i.e., the data points are being moved 
from the Move^From partition to the Move_From partition), the centers of these partitions need 
to be updated and re-calculated. For accomplishing the move U from S, to Sj , the count of each 
partition and the center of each partition needs to be re-calculated to accurately reflect the 
addition of new data points or the deletion of old data points as the case may be. 

For updating the counts of the two partitions, the following expressions can be employed: 

n t = n x — and 
nj~nj+\u\. 

For updating the centers of these two partitions, the following expressions can be 

employed: 

m t = (n x *mr m u )/(n r \u\) } and 
m.j = (nj*mj+ my)/(rij+\u\). 

If the value generated in step 3 14 is not greater than zero, processing proceeds to decision 
block 324, where a determination is made whether there are more data points to be checked. If 
there are more data points to be checked, then processing proceeds to step 314. 

If there are no more data points to be checked, then processing proceeds to decision 
block 334. Steps 314, 318, 324, and 344 form a single iteration of the processing. In decision 
block 334, a determination is made whether any data points were moved (i.e., changed 
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membership in partitions). When no data points are moved (i.e., when no data point changes 
membership in the partitions), then the processing is complete and stops (step 338). When one 
or more data points were moved (i.e., at least one data point changed membership in partitions), 
then processing proceeds to step 314 to process another iteration (i.e., steps 314, 318, 324 and 
5 344). 

Alternatively, decision block 334 can have a different stop or termination condition. The 
stop condition can be whether the change in the performance function is less than a 
predetermined value. 

;;J There are numerous applications that can utilize the aggregated clustering method and 

!( pl0 system of the present invention to cluster data. For example, these applications include, but are 
MJ not limited to, data mining applications, customer segmentation applications, document 
categorization applications, scientific data analysis applications, data compression applications, 
S; vector quantization applications, and image processing applications. 

Q The foregoing description has provided examples of the present invention. It will be 

15 appreciated that various modifications and changes may be made thereto without departing from 
the broader scope of the invention as set forth in the appended claims. 
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What is claimed is: 
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3 y A method for clustering data comprising: 

4 (a) receiving a plurality of data points for clustering; 

5 (b) receiving a size parameter for specifying the number of data points to be moved at 

6 one time; 

7 (c) clustering the data points by using the size parameter to generate clustered results; 

8 (d) determining whether the clustered results are satisfactory; 

9 (e) when the clustered results are satisfactory, stop clustering; 

"*™ 10 (f) otherwise when the clustered results are not satisfactory, revise the size parameter, 

: S .fS 

'f& 1 1 perform clustering based on the revised size parameter and the clustered results, 

%12 and proceed to step (d). 

;:Jl3 

f 14 2. The method of claim 1 wherein step (c) further comprises: 

15 (cl) evaluating subsets of data points in each cluster for moving into every other cluster 
:; H6 by using a predetermined metric; wherein the number of data points in the subset 

On is specified by the size parameter. 

18 

19 3. The method of claim 2 wherein step (cl) further comprises: 

20 determining a geometric center of the subset of data points being evaluated for a 

21 move; 

22 (cl_2) using the geometric center of the subset of data points in the predetermined metric 

23 to generate a value. 
24 

25 4. The method of claim 3 wherein step (cl) further comprises: 

26 (cl_3) determining whether the value is greater than zero; 

27 (cl_4) when the value is greater than zero, moving the subset of data points from a 

28 Move_From cluster to a Move_JTo cluster; 
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29 (cl_5) when the value is not greater than zero, determining if there are more subsets to 

30 evaluate; 

31 ( c l_6) when there are more subsets to evaluate, proceeding to step (cl); 

32 ( c l_7) when there are no more subsets to evaluate, determining whether any point has 

33 moved; 

34 (cl_8) when a point has moved, proceeding to step (cl); and 

35 ( c l_9) when no point has moved, stopping the processing. 

36 

37 5. The method of claim 4 wherein each data point has a membership with one cluster; 

38 wherein step (c 1_4) further comprises: 

2 39 simultaneously updating the membership of at least two data points from the membership 

j^40 of the Move_From cluster to the membership of the Move_To cluster. 

It 42 6. The method of claim 4 wherein step (cl_4) further comprises: 
:"^43 updating the count of the MoveJFrom cluster; 

':r:44 updating the center of the MoveFrom cluster;. 

5 ;N5 updating the count of the Move JTo cluster; and 

S46 updating the center of the Move To cluster. 

47 

48 7. The method of claim 1 wherein revising the size parameter of step (f) further comprises: 

49 (f_l) decreasing the size parameter. 
50 

51 8. The method of claim 1 wherein step (d) further comprises: 

52 employing a predetermined metric for determining whether the clustered results are 

53 satisfactory; wherein the predetermined metric includes a geometric center of the 

54 subset of points that are being evaluated for move. 
55 

56 9. The method of claim 8 wherein the predetermined metric includes the following 

57 expression: 
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58 where U is the subset of data points being evaluated for the move, | U\ is the size of U 

59 that is specified by the size parameter, m 00 is the geometric center of U, M } and rrij 

60 are the centers of the clusters and n t and «, are the counts of the clusters. 
61 

62 10. The method of claim 1 wherein the clustering method is utilized in one of a data mining 

63 application, customer segmentation application, document categorization application, scientific 

64 data analysis application, data compression application, vector quantization application, and 

65 image processing application. 

66 / 

67 A 1 . A clustering system comprising: 

68 (a) a source of data points to be clustered; and 

69 (b) an aggregated clustering module for moving at least two data points at one time 

70 between a Move_From cluster and a MoveTo cluster; 

71 wherein the aggregated clustering module includes 

72 a move determination unit for evaluating the move of subsets of data points from each 

73 cluster to every other cluster and determining when such a move should be 

74 performed; and 

75 an aggregated move unit coupled to the move determination unit that updates a 

76 Move JFrom count, Move_From center, a Move To count, and a MoveJTo 

77 center. 
78 

79 12. The clustering system of claim 1 1 wherein the aggregated clustering module further 

80 comprises: 

81 (a) a first input for receiving the data points; 

82 (b) a second input for receiving initial center points; 

83 (c) a third input for receiving a number of points to move at one time; 

84 (d) a parameter for storing the center point associated with each cluster 

85 (e) a parameter for storing the count of data points associated with each cluster; 
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86 wherein the data points, center points and counts, are utilized by the move determination 

87 unit for move evaluation and determination and by the aggregated move unit for 

88 count update and center update. 
89 

90 13. The clustering system of claim 1 1 wherein the move determination unit further 

91 comprises: 

92 a geometric center determination unit for determining the geometric center of a current 

93 subset of data points and providing the geometric center to the move 

94 determination unit for move evaluation and move determination. 
95 

j.Q 96 14. The clustering system of claim 13 wherein the move determination unit further 

m 97 comprises: 

J* 98 a move evaluation mechanism for employing a predetermined metric for move 

ffl 99 evaluation; wherein the predetermined metric includes the geometric center of a 

ulOO current subset of data points. 

Si 01 

Q102 15. The clustering system of claim 11 is configured for one of a data mining application, 

^103 customer segmentation application, document categorization application, scientific data analysis 

104 application, data compression application, vector quantization application, and image processing 

105 application. 
106 
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ABSTRACT OF THE DISCLOSURE 
An aggregated data clustering method and system. First, the data points to be clustered 
and a size parameter are received. The size parameter specifies the number of data points to be 
moved at one time in the clustering algorithm. Next, the data points are clustered by using an 

5 aggregated clustering algorithm (e.g., aggregated local K-Means clustering algorithm) and the 
size parameter to generate clustered results. Then, a determination is made whether of not the 
clustered results are satisfactory. If the clustered results are satisfactory, the clustering is 
stopped. Otherwise, a modified or refined parameter size is received. Then, clustering is 
performed on the clustered results generated previously by using the aggregated clustering 

10 algorithm and the revised or refined parameter size. The steps of determining, modifying the 
parameter size, and aggregated clustering are repeated until satisfactory clustering results are 
achieved. 
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false statements may jeopardize the validity of the application or any patent issued thereon. 



Full Name of Inventor: Bin Zhang 

Residence: 41945 Via San Gabriel, Fremont, CA 94539 

Post Office Address: Same 



Citizenship: ggzfaatofd CH /A/4 



inventor's Signature 

Rev 12/99 (DecPwr) 



Date 

(Use Page Two For Additional Inventor(s) Signature (s)) 



Page 1 of 2 



DECLARATION AND POWER OF ATTORNEY 
FOR PATENT APPLICATION (continued) 



ATTORNEY DOCKET NO. 10992482-1 



Full Name of # 2 joint inventor: Meichun Hsu 
Residence: 
Post Office Address: 



Citizenship: US 



12717 Leander Drive, Los Altos Hills CA. 94022 



Same 



inventor's Signature 



Date 



Full Name of # 3 joint inventor: Igor Kleyner 
Residence: 
Post Office Address: 



Citizenship: US 



434 Bally Way, Pacifica, CA 94044 



Same 



inventor' s Signature 



Date 



Full Name of # 4 joint inventor: 
•^Residence: 
fpost Office Address: 



inventor s signature 



Citizenship: 



Date 



Q Full Name of # 5 joint inventor: 

Residence: 
*t Post Office Address: 



inventor's signature 



Citizenship: 



Date 



Full Name of # 6 joint inventor: 

Residence: 

Post Office Address: 



Citizenship: 



inventor s Signature 



Date 



Full Name of # 7 joint inventor: 

Residence: 

Post Office Address: 



inventor's signature 



Citizenship: 



Date 



Full Name of # 8 joint inventor: 

Residence: 

Post Office Address; 



Citizenship: 



inventor s signature 

Rev 1 2/99 (DecPwrl 



Date 



{Use Page Two For Additional lnventor{s) Signature (s)} 



Page 2 of 2 



